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Abstract: This paper considers a discrete time swarm model of a group of mobile autonomous agents with 
a simple attraction and repulsion function for swarm aggregation and investigates its stability properties. 
In particular, it is proved that the individuals (members) of the swarm will aggregate and form a cohesive 
cluster of a finite size depending only on the parameters of the swarm model in a finite time, and the 
swarm system is completely stable. 
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1 Introduction 

In recent years the topic of swarms has attracted con- 
siderable attention because swarming behavior can 
be found in many organisms in nature, ranging from 
simple bacteria to large animals. Generally speak- 
ing, "swarm behavior" is a kind of aggregate motion 
that a variety of organisms have the ability to coop- 
eratively forage for food while trying to avoid preda- 
tors and other risks. Examples include colonies of 
ants, flocks of birds, and groups of animals. Under- 
standing the operational principles of such motions 
in swarms is useful in developing distributed cooper- 
ative control, coordination, formation control, and 
learning strategies for autonomous agent systems 
such as autonomous multi-robots; satellite group ma- 
neuvers; multiple unmanned undersea/aerial vehi- 
cles, etc. The increasing interest has been motivated 
to study the swarming behavior and its applications, 
and work on modelling of swarming behavior [l]-[4]. 
Specially, the collective dynamics models have been 
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explored in [5]-[14]. In this paper, we study swarm- 
ing behavior in terms of aggregation, cohesion, and 
stability of a group of mobile autonomous agents. 

In [15], Gazi and Passino proposed an "individual- 
based" continuous time model for swarm aggrega- 
tion in n-dimensional space with the same attraction- 
repulsion rule and with identical interaction strength 
among these individuals (or members) . They showed 
that the swarm with such model has the properties 
of aggregation, cohesion and stability. In this pa- 
per we develop a discrete time swarm model of a 
group of mobile autonomous agents moving in n- 
dimensional space, and analyze its aggregation and 
stability properties. Particularly, we will prove that 
individual agents can form a cohesive swarm with a 
finite size, which depends only on parameters of the 
swarm model, in a finite time. 

In section 2, we present the swarm model. Then 
we show that the model can converge to the center 
and have complete stability behavior (i.e., cohesion) 
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in section 3 and section 4, respectively. Finally we 
briefly summarize the results of this paper in section 
5. 

2 Swarm Model 

We consider a swarm of M individuals (or members) 
in an n-dimensional Euclidian space. We assume the 
motion is synchronous without delays, i.e., all these 
individuals move simultaneously and know the ex- 
act position of all the other members. The model is 
given by 

M 

Xi{k + 1) = Xi (k) + 9(xi(k) - Xj(k)) (2.1) 

where Xi{k) 6 R n represents the position of individ- 
ual i at time k, i € S, k € N; sets S = {1, 2, • • • , M} 
and N = {0, 1, 2, • • ■ }; g(-) represents the function of 
attraction and repulsion between the members. That 
is, the direction and magnitude of every individual 
depend on the sum of the attraction and repulsion of 
the other individuals on it. The attraction- repulsion 
function g(-) is of the form 

g(y(k)) = -y(k)(a-bexp(-M!^) ) '\ (2 . 2 ) 

where a, b, c are positive constants, and ||?/(fc)|| = 
y(k) T y(k), Vfc S N. 

We can see that this function is attractive for large 
distances and repulsion for small distances, and the 
function g(-) changes its sign when g(-) = (b > a), 
i.e., at the set of points as 

6= jy = or ||y(fc)|| = ^cln(^)=«jj. 
Definition 1: The center of the swarm members 

is 

1 M 

i=l 

By the symmetry property of function g(-) with 
respect to the origin, individual i moves to each other 
individual j just the same amount as j moves to i. 



This implies that the center x(k) is stationary for all 
k. Simultaneously, we have 

M 

^2(xi{k) - Xj{k)) = M( Xi {k) - x(k)) = Mei(k). 
i=i 

(2.3) 

Lemma 1: The center x(k) of the swarm described 
in Eqs. (|2.1|l and (|2.2|l is stationary for all k. 

Proof: By the symmetry of function g(-), we 
know that 

M M 

J2 E g(x l (k)-x J (k)) = o, 

then for all k. It follows that 

x(k+l)= iiEZi^k + l) 
= x(k). 

Hence the swarm center x(k) is stationary. 

This lemma says that the swarm described in Eqs. 
H2.1J) and (|2.2(l is not drifting on average. In the next 
section, we show that the individuals will move to- 
ward the swarm center and form a cohesive cluster 
around it. 

3 Swarm Aggregation 

This section presents results concerning aggregation 
properties of the autonomous agents swarm modeled 
in Eqs. (EjJ and lf2~2~|l . 

Definition 2: A swarm member i is a free agent 
if, for all k, 

\\ Xi (k) - Xj {k)\\ > S, VjeS, j^i. 

Since the swarm center x(k) is stationary, it is 
noted x for simplicity. 

Definition 3: The error variable is defined as 

e% (k) =Xi(k) -x, VieS, Vfc e N. 

Assumption 1: All the swarm members are free 
agents at any time k. 

Lemma 2: If a member i of the swarm is de- 
scribed by Eqs. H2.1(l and (|2.2(l . under Assumption 



1, its distance to the center x of the swarm is greater 
than <5, i.e., 

|| ei (fc)[| = \\xi(k) - x\\ > S. 

Then, at any time fc, it moves toward the center x; 
in other words, its motion is in a direction of decrease 
of ||e,(fc)||. 

Proof: Set 

A(i,i;fc) = exp ( J^)~ Xj (k)\r 



$ = cxp I — - 

•Eij\k) = %i\k) ^j'(^); 

and by 1)2. 3[) and Assumption 1, we have 

M 

Xi(k + 1) = Xi(k) - 2J Xij(k)(a — bA(i,j;k)) 

ii/ 

= Xi(k) — aM €i(k) + b Xij (k)A(i, j; fc), 

3=1 j'^* 

M 

= (1 - aM)ei(k) + b ^ Xij(k)A(i,j;k) + x, 
j=1j'#» 

thus 

M 

e. ( (fc + 1) = (1 -oM)e,(fc) + 6 x lj (k)A(i, j; k). 

J=l,3#< 

Let y,(fc + 1) = ^(fe + l)e t (fc + 1), then 

AK(ft) = ^(fc + l)-Fi(A;) 

< -a|| ei (fc)|| 2 - a (M-l)||e 4 (fc)|| 2 
+ i(a 2 +6 2 <i> 2 )M 2 || e ,(fc)|| 2 



+6(1 + aM)(M - l)5$||ei(fc)||. 



So 



A^(fc) < -a[[ ei (fc)|| 2 -(M-l)|| ei (fc)|| 
(a 2 + b 2 $ 2 )M 2 \ „ 



If 



2(M - 1) 
(l + aM)6<5$). 



I|e,(fc)|| > ^ a > 

a 2(M-1) 



for M large enough, then 

AVi(k) < -a||e»(fc)|| 2 = -2aVi(k). 

Thus the result holds. □ 
Remark 1: Lemma 2 does not say that Xi(k) will 
converge to x for all i and k. 

Theorem 1: As time progresses all the members 
of the swarm described in Eqs. I|2.1(l and (|2.2|l will en- 
ter into a bounded hyperball in a finite time bound 
k, 

B £ {x) = { Xl {k) : \\ Xi {k)-x\\ < e} 
where 



and 



k = max 



Vi(0) 



as* 



Proof: Let V$(fc + 1) = |e 4 (fc + l) T e i (fc + 1), and 
by Lemma 2, we know that if ||ej(fc)|| > 5, 
then we will have 

AVi(k) < 0. 

Note that function if? = A(i,j; k)\\xi(k) — Xj(k)\\ is 
a bounded decreasing function of the distance with 
the maximum occurring at ||xj(A;) — Xj(fc)|| = S, and 
we can obtain a position independent bound by using 
its maximum, (i.e., solving the continuous equation 

(yexp (— ^j) = 0). We know that it occurs 
at ||a:j(fc) — Xj(fc)|| = ,/|, So we can obtain that 
AVi(k) < as long as 



He* (*0II > ^yf ex P 



1 

2 

Define e = \\f\ exp (—5). This implies that as 
fc — > 00, ei{k) converges within the ball B e (x). No- 
tice that i is arbitrary, so the result holds for all the 
swarm members. 

Next, the finite time bound will be presented. 
Since 

AV i {k)=V i (k+l)-V i {k) 
and by AV t (k) < -a||e 4 (fc)|| 2 = -2aV t (k), we have 

Vi(k + 1)-Vi(0) = AVi(0) + ■ ■ ■ + AVi(k) 

< -2o(v i (o) + y i (i) + --- + K(fe)). 



Since Vj(fc) = i||ei(fc)|| 2 , we have, for ||ej(fc)|| = 
e, Vfc G N, 

Vi(0) > 2a • i £ 2 (fc + 1) + ie 2 > ate 2 , 



thus for all k. 



k < 



Vt(0) 



as* 



so we obtain the result, 



k = max 



□ 

Remark 2: Notice that this theorem is very im- 
portant not only because it shows the aggregation 
of the swarm and gives an explicit bound on the 
size of the swarm in a finite time bound, but also 
it says that when M is large enough, the bound on 
the swarm size only depends on the model parame- 
ters a, 6, c and is almost independent of the number 
of the swarm members. However, it does not say any- 
thing about the motion of the swarm members in the 
hyperball. Next we will study the issue further. 

4 Swarm Stability 

Now we prove that the swarm system described in 
Eqs. p.ljl and l|2.2|l will converge to its equilibrium 
points, and the configuration of the swarm members 
converges to a constant arrangement. Now we define 
the invariable set of equilibrium points of the swarm 
system as 



a 



M 

x : g(Xi — Xj) = 0, i G S 



where x = {xj , • • • , x] f } T G R Mn . 

Theorem 2: As k — ► oo, all the members of the 
swarm described in Eqs. (|2.1|l and (|2.2|l converge to 

Proof: For all k G N, let the Lyapunov function 

be 

Af-l M 

2 



M-l M 

Axi(k)) = -J2 E \\xm- Xj (k)\\ r < 



and we have 

AJ( Xi {k)) = J( Xi (k + 1)) - J{ Xi (k)). 
In fact, it can be seen that AJ(xi(k)) < as long as 



A=\\x l (k+l)-x J (k + l)\\ 2 -\\x l (k)-x J (k)\\ 2 <0. 



So next we will consider A, and for simplicity, we set 

\\ Xl {k) - Xl {k)\\^ 



9(i,l;k) = exp 
<f>{j,l;k) = exp 



\ Xj (k) - Xl (k)\\'< 



x^ (k) 


= Xi{k) - 


- Xj(k), 


xa{k) 


= x l (k) 


- xi{k), 


Xji(k) 


= Xj{k) 


- xi(k), 


i(k + l) 


— Xj (k 4 




-1), $ = exp( 



and then 



A = (l-aM)xij(k) 



A I 



-b\ 6(i,l;k)x a (k) 



M 



E <t>ti> l '>k)Xjl(k) j , 



so we have 
IIAII 2 = A T A 



< (1 - aAf) 2 ||^-(fc)|| 2 + b 2 t> 2 M 2 \\x l3 (k)\f 
+4b5(l + aM) (M - l)®\\xij (fc)||. 



Then, 



-A = -a||^(fc)|| 2 -(Af-l)||^(fc)|| 



x (a 



a 2 + 6 2 $ 2 
2(M-1) ' ll 3X 



-M 2 )||^-(fc)|| 



-265(1 + oJ\f)$) . 



i—l j—i+1 



Under Assumption 1, when M is large enough, we 
have 

\\ Xij {k)\\ >5, 

then 

||A|| 2 <-a||^-(fc)|| 2 <0. 



From this, 

AJ(xi(k)) = J{x t {k + 1)) - J{xi{k)) < 0. 

Thus by the LaSalle's Invariance Principle we can ob- 
tain the fact that as k — > 00 the state Xi(k) converges 
to the largest invariant subset of the set defined as 

Q = {x : AJ(x) = 0} 

r m | 

= \ x: 9(x l -x j ) = 0\ 

[ j=i,j¥* J 

= n e . 

Because each point in f2 e is an equilibrium, Q is an 
invariant set. This result is proved. □ 
Remark 3: Notice that the stability of the swarm 
system implies global convergence to its equilibrium 
point set. And we know that it does not require the 
system to have unique equilibrium point. Moreover, 
note also that in the analysis of the above results, 
the dimension of the state space n was not used so 
that these results hold for any dimension. 

5 Conclusion 

We have shown that the swarm model described in 
Eqs. 1|2.1|) and l|2.2[) can exhibit aggregation, co- 
hesion, and global convergence behavior. That is, 
such properties are of practical interest in formation 
control of multi-robot systems. All members of the 
swarm eventually enter into a finite size ball in a 
finite bounded time and converge to a constant ar- 
rangement. 
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